Text–to–Video: Image Semantics and NLP

When aiming at automatically translating an arbitrary text into a visual story, the main challenge consists in finding a semantically close visual representation whereby the displayed meaning should remain the same as in the given text. Besides, the appearance of an image itself largely influences how its meaningful information is transported towards an observer. This thesis now demonstrates that investigating in both, image semantics as well as the semantic relatedness between visual and textual sources enables us to tackle the challenging semantic gap and to find a semantically close translation from natural language to a corresponding visual representation. Within the last years, social networking became of high interest leading to an enormous and still increasing amount of online available data. Photo sharing sites like Flickr allow users to associate textual information with their uploaded imagery. Thus, this thesis exploits this huge knowledge source of user generated data providing initial links between images and words, and other meaningful data. In order to approach visual semantics, this work presents various methods to analyze the visual structure as well as the appearance of images in terms of meaningful similarities, aesthetic appeal, and emotional effect towards an observer. In detail, our GPU-based approach efficiently finds visual similarities between images in large datasets across visual domains and identifies various meanings for ambiguous words exploring similarity in online search results. Further, we investigate in the highly subjective aesthetic appeal of images and make use of deep learning to directly learn aesthetic rankings from a broad diversity of user reactions in social online behavior. To gain even deeper insights into the influence of visual appearance towards an observer, we explore how simple image processing is capable of actually changing the emotional perception and derive a simple but effective image filter. To identify meaningful connections between written text and visual representations, we employ methods from Natural Language Processing (NLP). Extensive textual processing allows us to create semantically relevant illustrations for simple text elements as well as complete storylines. More precisely, we present an approach that resolves dependencies in textual descriptions to arrange 3D models correctly. Further, we develop a method that finds semantically relevant illustrations to texts of different types based on a novel hierarchical querying algorithm. Finally, we present an optimization based framework that is capable of not only generating semantically relevant but also visually coherent picture stories in different styles.Bei der automatischen Umwandlung eines beliebigen Textes in eine visuelle Geschichte, besteht die größte Herausforderung darin eine semantisch passende visuelle Darstellung zu finden. Dabei sollte die Bedeutung der Darstellung dem vorgegebenen Text entsprechen. Darüber hinaus hat die Erscheinung eines Bildes einen großen Einfluß darauf, wie seine bedeutungsvollen Inhalte auf einen Betrachter übertragen werden. Diese Dissertation zeigt, dass die Erforschung sowohl der Bildsemantik als auch der semantischen Verbindung zwischen visuellen und textuellen Quellen es ermöglicht, die anspruchsvolle semantische Lücke zu schließen und eine semantisch nahe Übersetzung von natürlicher Sprache in eine entsprechend sinngemäße visuelle Darstellung zu finden. Des Weiteren gewann die soziale Vernetzung in den letzten Jahren zunehmend an Bedeutung, was zu einer enormen und immer noch wachsenden Menge an online verfügbaren Daten geführt hat. Foto-Sharing-Websites wie Flickr ermöglichen es Benutzern, Textinformationen mit ihren hochgeladenen Bildern zu verknüpfen. Die vorliegende Arbeit nutzt die enorme Wissensquelle von benutzergenerierten Daten welche erste Verbindungen zwischen Bildern und Wörtern sowie anderen aussagekräftigen Daten zur Verfügung stellt. Zur Erforschung der visuellen Semantik stellt diese Arbeit unterschiedliche Methoden vor, um die visuelle Struktur sowie die Wirkung von Bildern in Bezug auf bedeutungsvolle Ähnlichkeiten, ästhetische Erscheinung und emotionalem Einfluss auf einen Beobachter zu analysieren. Genauer gesagt, findet unser GPU-basierter Ansatz effizient visuelle Ähnlichkeiten zwischen Bildern in großen Datenmengen quer über visuelle Domänen hinweg und identifiziert verschiedene Bedeutungen für mehrdeutige Wörter durch die Erforschung von Ähnlichkeiten in Online-Suchergebnissen. Des Weiteren wird die höchst subjektive ästhetische Anziehungskraft von Bildern untersucht und "deep learning" genutzt, um direkt ästhetische Einordnungen aus einer breiten Vielfalt von Benutzerreaktionen im sozialen Online-Verhalten zu lernen. Um noch tiefere Erkenntnisse über den Einfluss des visuellen Erscheinungsbildes auf einen Betrachter zu gewinnen, wird erforscht, wie alleinig einfache Bildverarbeitung in der Lage ist, tatsächlich die emotionale Wahrnehmung zu verändern und ein einfacher aber wirkungsvoller Bildfilter davon abgeleitet werden kann. Um bedeutungserhaltende Verbindungen zwischen geschriebenem Text und visueller Darstellung zu ermitteln, werden Methoden des "Natural Language Processing (NLP)" verwendet, die der Verarbeitung natürlicher Sprache dienen. Der Einsatz umfangreicher Textverarbeitung ermöglicht es, semantisch relevante Illustrationen für einfache Textteile sowie für komplette Handlungsstränge zu erzeugen. Im Detail wird ein Ansatz vorgestellt, der Abhängigkeiten in Textbeschreibungen auflöst, um 3D-Modelle korrekt anzuordnen. Des Weiteren wird eine Methode entwickelt die, basierend auf einem neuen hierarchischen Such-Anfrage Algorithmus, semantisch relevante Illustrationen zu Texten verschiedener Art findet. Schließlich wird ein optimierungsbasiertes Framework vorgestellt, das nicht nur semantisch relevante, sondern auch visuell kohärente Bildgeschichten in verschiedenen Bildstilen erzeugen kann

Midwives’ engagement in smoking- and alcohol-prevention in prenatal care before and after the introduction of practice guidelines in Switzerland : comparison of survey findings from 2008 and 2018

Background: Evidence suggests that cigarette smoking and alcohol consumption during pregnancy negatively impacts fetal health. Health agencies across countries have developed specific guidelines for health professionals in perinatal care to strengthen their role in smoking and alcohol use prevention. One such example is the “Guideline on Screening and Counselling for prevention of cigarette smoking and alcohol consumption before, during, and after pregnancy” introduced by the Swiss Midwives Association in 2011. The current study assesses the changes in midwives’ engagement in smoking and alcohol use prevention before (2008) and after the introduction of the Guideline (2018). Further, the current study examines differences across regions (German vs. French speaking regions), graduation years (before and after the introduction of the Guideline) and different work settings (hospital vs. self-employed). Methods: Survey data were collected in 2008 (n = 366) and in 2018 (n = 459). Differences in how midwives engaged in smoking and alcohol use prevention between 2008 and 2018 were assessed with chi-square tests, as were differences across German and French speaking regions, graduation years (before and after the introduction of the Guideline) and across different work settings (working in hospitals or as self-employed). Results: An increase in midwives’ awareness of the risks of consuming even small quantities of cigarettes and alcohol for the unborn child between 2008 and 2018 is evident. Explaining the risks to pregnant women who smoke or use alcohol remained the most frequently reported prevention strategy. However, engagement with more extensive smoking and alcohol use preventive strategies across the whole course of pregnancy, such as assisting women in the elaboration of a plan to stop smoking/alcohol use, remained limited. Conclusions: Seven years after its introduction, the effectiveness of the Guideline in increasing midwives’ engagement in smoking and alcohol use prevention appears limited despite midwives’ increased awareness

Evidenzbasierter Einsatz von Protonenpumpeninhibitoren

Protonenpumpeninhibitoren (PPIs) werden als Mittel der ersten Wahl bei säurebedingten Erkrankungen wie GERD, peptische Ulcuserkrankung und zur Eradikation des Helicobacter pylori eingesetzt. Wegen ihres ausgezeichneten Sicherheitsprofils werden sie sehr häufig und oft ohne vorliegende gerechtfertigte Indikation verschrieben. Auch PPIs zeigen unerwünschte Nebenwirkungen, vor allem bei Langzeiteinnahme, und interagieren mit anderen Arzneistoffen durch Senkung des pH-Wertes im Magen oder durch Interaktion über das CYP2C19-Enzym. Anhand evidenzbasierter Guidelines und aktueller Studien wurde eine Checkliste angefertigt, mit deren Hilfe überprüft werden kann, ob die PPI-Gabe gerechtfertigt oder nicht gerechtfertigt ist. Die Überprüfung der Anwendbarkeit der Liste erfolgte im SMZO Wien. Es zeigte sich, dass bei einer Mehrzahl der Patienten die PPI-Gabe nicht gerechtfertigt war. Die Gründe der nicht gerechtfertigten Gabe waren eine PPI-Gabe bei Multimedikation und eine zu hohe Dosis bei der Prophylaxe NSAID/ASS-assoziierter Ulcera. Weiters konnte festgestellt werden, dass die simultane Gabe von Clopidogrel plus PPI sehr umstritten ist. Eine weitere Datenerhebung mithilfe der erstellten Checkliste ist auf jeden Fall sinnvoll. Vor allem auch, um die anderen Indikationsgebiete der PPIs zu durchleuchten und um weitere Gründe eventuell nicht gerechtfertigter PPI-Verschreibungen zu ermitteln, mit dem Ziel des rationalen Einsatzes der Protonenpumpeninhibitoren

Experimental investigation of forces along anchors subjected to dynamic loading under tension and compression in field tests

Full-scale field tests of dynamic rockfall have been performed on a flexible SPIDER Avalanche System to study the dynamic force distribution along the foundations under dynamic loading. Therefore, an anchor to measure dynamic tensile forces and a pile to measure dynamic compressive forces were each equipped with strain gauges. Furthermore, a static pull loading test with load steps of one-minute duration was performed on the anchor to highlight the difference between dynamic and static loading. Effective kinetic energies applied on the net of the SPIDER Avalanche System range from 25 to 492 kJ with impact velocities between 17 and 25 m/s. The results show that the dynamic forces close to the pile- and anchor head are higher and that they are decreasing with increasing distance of pile and anchor. However, the dynamic tensile force distribution is non-linear over the length of the anchor, whereas the dynamic compressive force distribution is linear along the pile length. The comparison of static and dynamic tensile forces shows that dynamic tensile forces are depleted within a shorter distance of the anchor compared to the static tensile forces. Dynamic tensile forces present 25% less in value than the static tensile forces

Zwei Beispiele aus der Praxis des Musikunterrichts

Die hier vorgestellten Beispiele aus der Praxis des Musikunterrichts in dritten und vierten Klassen stellen vielfältige Bezüge her zu den vier im Beitrag von Constanze Rora und Lutz Schäfer beschriebenen Dimensionen ästhetischer Erfahrung und möchten Anregung sein, ästhetische Erfahrungen im eigenen Unterricht zu ermöglichen. Es werden jeweils zunächst der Ablauf des Unterrichtsvorschlags vorgestellt und dann in einem weiteren Schritt die Bezüge zum theoretischen Rahmen aufgezeigt. (DIPF/Orig.

SFTA2 - a novel secretory peptide highly expressed in the lung - is modulated by lipopolysaccharide but not hyperoxia

Tissue-specific transcripts are likely to be of importance for the corresponding organ. While attempting to define the specific transcriptome of the human lung, we identified the transcript of a yet uncharacterized protein, SFTA2. In silico analyses, biochemical methods, fluorescence imaging and animal challenge experiments were employed to characterize SFTA2. Human SFTA2 is located on Chr. 6p21.33, a disease-susceptibility locus for diffuse panbronchiolitis. RT-PCR verified the abundance of SFTA2-specific transcripts in human and mouse lung. SFTA2 is synthesized as a hydrophilic precursor releasing a 59 amino acid mature peptide after cleavage of an N-terminal secretory signal. SFTA2 has no recognizable homology to other proteins while orthologues are present in all mammals. SFTA2 is a glycosylated protein and specifically expressed in nonciliated bronchiolar epithelium and type II pneumocytes. In accordance with other hydrophilic surfactant proteins, SFTA2 did not colocalize with lamellar bodies but colocalized with golgin97 and clathrin-labelled vesicles, suggesting a classical secretory pathway for its expression and secretion. In the mouse lung, Sfta2 was significantly downregulated after induction of an inflammatory reaction by intratracheal lipopolysaccharides paralleling surfactant proteins B and C but not D. Hyperoxia, however, did not alter SFTA2 mRNA levels. We have characterized SFTA2 and present it as a novel unique secretory peptide highly expressed in the lung

Potentials of using milk performance data and FAMACHA score as indicators for Targeted Selective Treatment in Lacaune dairy sheep in Switzerland

Targeted Selective Treatment (TST) is one approach to slow down the development of anthelmintic resistance. Its success is closely linked to the correct identification of animals in need of treatment. In dairy goats it has been proposed to use milk yield as TST indicator and to focus treatments on high yielding dairy goats. In dairy sheep the relationship between milk performance and infection with gastrointestinal nematodes (GIN) is not well known. The aim of this study was to investigate the relationship between milk yield and GIN infection in dairy sheep and based on this, to evaluate milk performance data as a potential TST indicator. Overall 1159 Lacaune ewes of 15 dairy sheep farms in Switzerland were included in the study. The ewes were phenotyped once between August and December 2019, when they were at least 70 days in milk (DIM). Individual faecal samples were taken from every ewe to determine the nematode egg concentration per gram faeces (EPG). In addition, the clinical parameters FAMACHA score and packed cell volume (PCV) were measured. Linear mixed models were used to analyse the effects of the collected parameters on EPG. EPG increased significantly with increasing test day milk yields (P = 0.002), indicating high yielding ewes to be less resistant to GIN infections than low yielding ewes. The effect was most pronounced in earlier lactation but remained within a moderate range. Overall, our results indicated the potential of using milk yield data of rather early lactation as TST indicator in dairy sheep. On farms with predominantly H. contortus the combination with FAMACHA might improve the correct identification of highly infected ewes, as FAMACHA was correlated with EPG (r = 0.37, P < 0.001)

Dissection of Highly Prevalent qnrS1-Carrying IncX Plasmid Types in Commensal Escherichia coli from German Food and Livestock

Plasmids are mobile genetic elements, contributing to the spread of resistance determinants by horizontal gene transfer. Plasmid-mediated quinolone resistances (PMQRs) are important determinants able to decrease the antimicrobial susceptibility of bacteria against fluoroquinolones and quinolones. The PMQR gene qnrS1, especially, is broadly present in the livestock and food sector. Thus, it is of interest to understand the characteristics of plasmids able to carry and disseminate this determinant and therewith contribute to the resistance development against this class of high-priority, critically important antimicrobials. Therefore, we investigated all commensal Escherichia (E.) coli isolates, with reduced susceptibility to quinolones, recovered during the annual zoonosis monitoring 2017 in the pork and beef production chain in Germany (n = 2799). Through short-read whole-genome sequencing and bioinformatics analysis, the composition of the plasmids and factors involved in their occurrence were determined. We analysed the presence and structures of predominant plasmids carrying the PMQR qnrS1. This gene was most frequently located on IncX plasmids. Although the E. coli harbouring these IncX plasmids were highly diverse in their sequence types as well as their phenotypic resistance profiles, the IncX plasmids-carrying the qnrS1 gene were rather conserved. Thus, we only detected three distinct IncX plasmids carrying qnrS1 in the investigated isolates. The IncX plasmids were assigned either to IncX1 or to IncX3. All qnrS1-carrying IncX plasmids further harboured a β-lactamase gene (bla). In addition, all investigated IncX plasmids were transmissible. Overall, we found highly heterogenic E. coli harbouring conserved IncX plasmids as vehicles for the most prevalent qnr gene qnrS1. These IncX plasmids may play an important role in the dissemination of those two resistance determinants and their presence, transfer and co-selection properties require a deeper understanding for a thorough risk assessment